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Summary 


Several  ra.eni.n3  moaels  are  considered  in  wiiich  a  job  requires  a 
number  of  different  services.  The  services  are  performed  in  any  sequence, 
possibly  simultaneously,  by  a  number  of  servers.  Steady  state  probabili¬ 
ties  are  found  for  two  service  jobs  processed  by  two  server  systems.  In 
the  first  system,  the  two  servers  work  on  the  same  job  if  they  are  working. 
In  the  second  system,  the  servers  may  work  on  different  jobs.  If  server 
one  is  working  on  job  k,  server  two  may  be  working  on  job  k-1 ,  k,  or  k+1 
but  not  on  k-2  or  k+2.  In  these  systems,  the  servers  are  specialists.  In 
the  third  system,  the  servers  may  perform  either  of  the  two  required  serv¬ 
ices.  If  one  has  bogged  down,  the  other  server  does  both  parts  of  each 
job.  A 

A 


1.  Introduction 


cueuing  theory  thus  far  has  concentrated  on  the  study  of  single 
server  or  parallel  channel  queues.  Since  the  former  is  only  a  special  case 
of  the  latter,  ctudy  has  focused  on  only  one  type  of  system  element.  What 
network  theory  has  been  developed  concerns  the  processing  of  jobs  requiring 
a  sequence  of  services  at  different  facilities.  The  purpose  of  this  dis¬ 
cussion  is  to  focus  attention  on  more  general  organization,  in  particular, 
the  need  to  relax  the  serial  nature  of  systems.  The  traditional  models  of 
production  processes  are  the  job  shop  and  line.  Both  concepts  emphasize 
the  serial  nature  of  operations;  the  former  allows  many  sequences  while  the 
latter  uses  one  fixed  sequence.  It  is  interesting  to  note  that  the  concept 
of  line  production  is  associateu  with  assembly  lines  historically.  Perhaps 
a  more  natural  model  of  an  assembly  type  process  is  a  pyramid  where  each 
stage  of  production  combines  the  outputs  of  a  number  of  different  sub¬ 
processes  . 

The  simplest  possible  case  which  provides  at  least  some  of  the 
flavor  of  the  more  general  organization  is  one  in  which  a  job  requires  a 
number  of  services  by  an  equal  number  of  servers  with  no  sequencing  restric¬ 
tion.  Assuming  that  a  job  consists  of  n  parts  and  that  the  system  has  n 
servers,  the  n  servers  are  permitted  to  work  simultaneously  on  the  n  parts 
of  the  job.  Admitting  the  possibility  of  simultaneous  work  by  the  servers 
does  not  mean  that  this  is  necessary  or  desirable.  A  number  of  disciplines 
could  be  used  to  control  such  a  system.  At  one  extreme,  one  might  require 
all  n  servers  to  be  idle  before  a  new  job  could  start.  At  the  opposite  end 
of  the  spectrum  of  disciplines,  one  might  have  each  server  perform  as  much 
work  as  he  could  on  every  job  in  the  system  before  becoming  idle. 

This  class  of  systems  introduces  a  second  kind  of  queuing  into  the 
system,  for  not  only  are  jobs  waiting  for  processing  but  also  there  is  an 
inventory  of  partially  completed  work.  If  the  n  servers  are  a  sub-system  of 
a  larger  processing  system,  there  will  be  two  inventories  between  successive 
stages  of  production  corresponding  to  partially  completed  and  fully  com¬ 
pleted  jobs.  The  importance  of  the  partially  completed  job  inventory  natu¬ 
rally  varies  greatly  with  the  queue  discipline  which  is  used.  In  systems 
where  each  of  the  n  servers  is  busy  so  long  as  there  xs  any  work  that  he 
can  do,  the  inventory  will  be  important  if  not  excessive.  The  situation 
will  be  even  more  critical  if  priorities  are  used  in  the  selection  of  the 
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next  job  to  be  done  by  each  server  so  that  the  different  servers  may  process 
jobs  in  different  orders. 

Unfortunately,  it  appears  that  analytic  work  will  not  produce 
explicit  results  for  any  large  number  of  these  systems.  Even  the  assump¬ 
tion  of  poisson  input  and  negative  exponential  service  times  which  assures 
that  the  steady  state  probabilities  may  be  studied  by  solving  systems  of 
linear  equations  does  not  simplify  the  situation  sufficiently.  The  major 
difficulty  is  that  the  state  of  the  system  becomes  a  two-dimensional  quantity 
even  in  the  simplest  models.  One  approach  to  the  study  of  these  models  is  to 
show  that  solutions  have  a  particular  form  involving  some  parameters  which 
are  the  roots  of  a  polynomial  equation  of  high  degree.  The  crucial  point 
here  is  to  show  that  the  roots  are  distinct.  Rather  than  follow  this  ap¬ 
proach,  this  paper  considers  simple  systems  in  which  the  parameters  of  the 
solution  may  be  found  explicitly.  This  facilitates  the  comparison  of 
different  types  of  systems  which  is  so  necessary  in  developing  understand¬ 
ing  of  networks  of  queues. 

2.  One  Job  At  A  Time 

The  most  restricted  queue  of  the  type  considered  requires  that 
all  n  servers  work  on  the  same  job  if  they  work  at  all.  This  minimizes  the 
partially  completed  jobs  inventory  and  also  the  capacity  of  the  system.  For 
want  of  a  better  measure,  the  maximum  load  for  which  a  steady  state  exists 
will  be  used  as  the  measure  of  capacity.  Having  already  assumed  negative 
exponential  service  times,  if  one  further  assumes  that  the  service  rates 
are  equal,  he  has  a  particularly  simple  system.  The  system  is  completely 
equivalent  to  a  single  channel  system  with  a  special  negative  exponential 
phase  service  process.  The  service  process  is  not  Erlang  but  a  close 
relative.  The  relation  of  the  job  service  time  to  the  server  service  time 
is: 

prob  (job  service  time  <  t)  *  [prob  (server  service  time  <  t)]n 
For  the  negative  exponential  with  mean  yu  for  each  server  this  is: 

F(t)  =  [l-e"^V 

using  F(t)  to  denote  the  distribution  of  system  service  time  (T) .  The 
expected  service  time  is  given  by: 

E(T)  =  jtn(l-e'/*4t)n”/Ae“/<tdt  =  -~- 

J.  t=\  V 


3 


This  suggests  the  rational  for  the  construction  of  the  equivalent  phase  serv¬ 
ice;  n  phases  with  the  mean  of  the  i’th  phase  — or  with  service  rate(m+l-iY, 

(m+l-i)/*  S' 

The  first  phase  is  the  time  to  the  completion  of  the  first  service  regard¬ 
less  of  which  server  finishes.  The  second  phase  is  the  time  between  the 
first  and  second  completions,  again  regardless  of  which  servers  finish,  etc. 
The  first  phase  is  then  the  minimum  of  n  independent  negative  exponentials 
which  is,  of  course,  a  negative  exponential  with  mean  n^.  The  second  phase 
is  similar  due  to  the  forgetful  property  of  the  negative  exponential  but 
only  n-1  servers  are  functioning.  The  process  continues  until  the  last  phase 
is  the  extra  time  required  by  the  slowest  server. 

Analysis  of  the  queue  in  this  system  presents  no  great  difficulty. 
The  situation  is  best  understood  from  a  picture.  Let  be  the  number  of 
jobs  in  the  system,  including  the  one  in  service  in  conventional  style,  and 
N2  be  the  number  of  services  which  have  been  completed.  The  state  of  the 
system  is  the  two  dimensional  random  variable  (N  ,  N  ) .  The  diagram  for 
definiteness  is  for  a  four-server  system  and  only  for  the  first  three  values 
of  which  is  assumed  to  have  no  bound. 


The  normal  queuing  equations  can  easily  be  constructed  for  an  m 


server  system. 
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In  steady  state,  the  left  side  is,  of  course,  the  zero  vector.  Furthermore, 
by  summing  equations  one  easily  verifies  that: 


,  =  A 

/  n+l,m 


m-1 
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i=0 


p 

n,i 


using  lower  case  p's  for  steady  state  probabilities.  With  this  substitution 

and  using  P  for  the  vector  with  components  p  .  ,  i  =  . .  .m. 
n  n ,  i 
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This  format  of  the  recursion  relationship  corresponds  to  >)iPi  =  /,i+iPi+i 

for  the  simple  queue  which  permits  direct  transitions  only  among  neighboring 
states  of  the  system.  The  relationship  is  in  good  form  for  numerical  work, 
since  the  operations  of  matrix  inversion  and  multiplication  are  readily 
available  on  computing  machines. 

Further  work  on  the  relationship  would  require  that  the  matrix  on 
the  right  side  of  the  equation  have  an  easily  obtainable  inverse  in  terms  of 
the  symbolic  service  and  arrival  rates.  This  step  is  really  net  important, 
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however,  for  it  is  really  the  representation  of  the  nth  power  of  the  inverse 
which  is  needed.  If  the  eigen  values  of  the  inverse  are  all  distinct,  the 
representation  of  the  nth  power  takes  on  a  simple  form.  The  eigen  value 
problem  is  thus  at  the  heart  of  finding  a  simplification  of  the  relationship. 

The  same  problem  precisely  is  found  if  one  uses  a  generating  func¬ 
tion  approach.  Let: 

/Yi  =  2>„,izn  and  =  <W  »Tm-l) 

n=0 


Then  by  multiplying  the  steady  state  equations  by  the  appropriate  power  of 
z and  summing  one  obtains: 
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for  z=l  the  matrix  on  the  left  is  singular.  This  difficulty  can  be  repaired 
by  replacing  one  equation  by  the  sum  of  the  equations  divided  by  (z-1).  The 
sum  of  the  equation  is: 


[  X(z-l)  ,  >(z-l) . (X(z-l)  *  “ ( z— 1 )  )  ]  7^=0 


or  [A,X,  •  • 


(A- )]  7f=  0 

A 


This  is  the  same  device  used  to  reduce  the  original  recurrence  relationship 
involving  three  groups  of  probabilities  to  one  involving  only  two  groups. 

If  the  generating  functions  are  to  assist,  one  must  solve: 
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This  requires  the  inversion  of  the  matrix  on  the  left.  If  one  wants  not 
only  the  moments  but  also  the  probabilities,  partial  fraction  expansions 
will  be  required.  This  is  the  eigen  value  problem  in  the  previous  approach 
in  a  slightly  different  form. 

Although  it  is  possible  that  there  is  a  reasonable  representation 
of  the  eigen  values  as  functions  of  the  number  of  Bervice  phases,  the  func¬ 
tions  have  not  been  discovered.  For  the  purposes  of  this  paper  since  the 
same  difficulty  appears  in  variations  of  this  system,  attention  will  be 
focused  on  the  simplest  possible  case,  two  servers.  In  this  case,  the  gen¬ 
erating  function  equations  are: 


h 

x  \ 
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After  some  algebra  this  becomes: 


7r= 


As  usual,  the  pQ  Q 
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can  be  eliminated  by  /^(1)+7T(1)  =  1. 
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Thus: 


Since  this  is  a  probability,  it  must  be  between  zero  and  one,  which  re¬ 
stricts  ^/ju.  to  be  less  than  2/3.  Using /o  for  ,  the  expected  number  of 
Jobs  in  the  system,  E(N^) ,  is  found  from: 

E<V  =  ^/(1)+#i(1) 


where  the  prime  denotes  differentiation  with  respect  to  z.  Simplifying  the 
result  gives: 


E(N) 


/M3^1 
2-3  /* 
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Since  ft  (1)  and  /T(l)  are  the  marginal  probabilities  in  N,  ,  the 
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expectation  of  N  is  just  /T  ( 1 ) , 
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This  is,  of  course,  both  the  probability  that  a  phase  of  a  job  has  been  com¬ 
pleted  and  the  expected  number  of  completed  phases. 

Finally,  the  p's  may  be  obtained: 
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This  is  a  rather  awesome  quantity  of  symbols.  By  substituting  the  values  of 
e^  and  e^ ,  one  can  write  these  expressions  in  a  form  in  which  the  square 
root  has  been  eliminated.  Thus,  this  representation  is  only  a  concise  way 
of  writing  rational  functions  of  polynomials  of  degree  2n+l  in  A  and 

The  comparison  of  these  results  with  single  server  systems  is  rea¬ 
sonably  straight  forward.  The  capacity  has  been  reduced  to  2/3  of  that  of 
the  single  server  queue  with  service  rate/A  or  this  same  system  with  each 
server  working  as  long  as  there  are  jobs  waiting  regardless  of  the  progress 
of  the  other  server.  The  same  comment  holds  if  one  considers  the  single 
server  system  which  processes  both  parts  of  the  job.  One  might  envision  this 
type  of  system  if  the  two  servers  could  work  co-operatively  on  the  same  item 
without  interfering  with  each  other.  Such  a  system  is  an  E/E  /I  system.  A 
strong  word  of  warning  needs  to  be  injected  before  one  comes  to  the  conclu¬ 
sion  that  this  form  of  organization  is  dominated  in  the  sense  that  it  must 
always  produce  more  congestion.  In  real  systems,  it  is  generally  far  from 
true  that  division  of  a  job  into  parts  for  processing  by  specialists  corre¬ 
sponds  to  going  from  E/EJ\  to  the  present  system.  The  specialist  doing 
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half  of  the  job  often  takes  much  less  than  one  half  the  time.  Thus,  these 
results  indicate  some  order  of  magnitude  which  the  effects  of  specialization 
must  have  on  the  service  time  if  congestion  problems  are  not  to  change  radi¬ 
cally.  Furthermore,  this  one  measure  of  capacity  does  not  tell  the  whole 
story  about  congestion. 

3,  Two  Jobs  At  A  Time 

One  would  undoubtedly  like  to  describe  the  general  situation  as  a 
function  of  the  maximum  number  of  the  jobs  in  the  in-process  inventory.  If 
one  is  content  to  leave  the  results  in  terms  of  some  parameters  which  are  the 
roots  of  a  polynomial  equation,  this  can  be  accomplished.  On  the  other  hand, 
if  no  such  parameters  are  allowed,  the  possibilities  are  severely  restricted. 
In  the  former  case,  numerical  work  seems  required  to  stimulate  one’s  under¬ 
standing  of  the  system  and  the  latter  is  the  spirit  of  this  paper.  In  the 
limiting  case  where  the  servers  only  stop  work  because  of  a  zero  queue  of 
work  of  the  appropriate  type,  the  servers  act  independently.  As  far  as  the 
phases  of  jobs  yet  to  be  started,  such  a  system  looks  like  n  independent 
queues.  The  capacity  is  obviously  one.  The  size  of  the  work  in  process, 
however,  is  not  clear;  for  it  cannot  be  studied  by  decomposing  the  system 
into  n  independent  queues.  At  lease  one  special  case  can  be  solved  in  the 
sense  that  the  distributions  of  the  queue  sizes  can  be  found  explicitly.  This 
is  the  case  of  the  two  server  system  in  which  at  most  two  jobs  can  be  in 
process  at  one  time.  One  important  reason  for  this  is  that  again  summation 
of  the  equations  will  reduce  the  recurrence  relation  from  one  involving  three 
groups  of  states  to  one  involving  only  two  groups. 

Another  way  of  stating  this  guarantee  of  easy  solution  is  that  it 
is  possible  to  divide  the  states  of  the  system  into  groups,  which  may  be 
ordered,  and  that  transitions  from  a  higher  group  to  a  lower  one  are  made 
only  from  one  state  in  the  higher  group.  That  this  is  true  in  this  case  may 
be  seen  by  reference  to  the  state  space  diagram.  Again  is  the  number  of 
jobs  in  the  system  and  N  is  the  number  of  job  parts  which  have  been  com- 
pleted.  Assuming  equal  service  rates  for  the  two  servers,  it  is  unnecessary 
to  keep  track  of  which  server  has  completed  which  job.  Only  the  first  part 
of  the  diagram  is  shown,  the  same  pattern  is  repeated  for  higher  values  of 
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It  is  no  longer  true  that  any  grouping  will  have  the  required 

property.  If  one  forms  groups  (n,0),  (n,l),  (n+i,2),  the  only  state  of 

the  group  from  which  one  may  move  to  a  lower  group  is  (n,l). 

Again  let  P  be  the  vector  of  steady  state  probabilities  of  the 
n 

states  in  group  n. 
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For  convenience,  a  rather  odd  ordering  of  the  states  has  oeen  used.  The 
basic  steady  state  equations  are: 

/ - 1  -2/w  2  ^  /0  0  ON 

0  =  AP  ,  +  /  0  -vi-2~  0  \  P  +  /  .,  0  0  1  P 

n-1  •'  '  >  n  i  '  ■  j  n+1 

,0  0  \/'  0  °/ 

There  are,  of  course,  appropriate  modifications  for  the  PQ  vector  since 
states  (0,1)  and  (1,2)  do  not  exist.  Also,  it  is  not  possible  to  have 
services  in  state  (0,0),  and  state  (1,1)  allows  only  one  server  to  be  busy 
while  in  other  states  (n,l)  both  servers  are  busy.  The  special  problems  of 
the  first  few  states  are,  of  course,  irrelevant  to  the  fundamental  question 
of  how  to  simplify  the  basic  recurrence  relationship.  By  summing  the  gen¬ 
eral  equations  for  all  index  values  larger  than  n  one  finds: 
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->/2  ; 

P 

n 

\  -  >2 

-  /2 

>/2W 

The  inversion  of 

a  three  by 

three  by  hand 

although  tedious  is  nevertheless 

quite  feasible. 

This  gives: 

P  =  iff 
n  n-i 

where  j  /2y^ 

*/2,<A 

;V2a<  \ 

'  ><X+*) 

2  2 
A  +3/^+ 4/*^ 

A('+3  ) 

R  = 

i  2/f(3A+4//) 

1 

2/2(d>+^) 

2,<;  (3  A  +4^,)  | 

l 

\  >(''+2^) 

*(A+4a) 

.  2  2  : 

A  +4A  /M  +8/-<  i 

\  2 

y  (o^+4^) 

2/*(3>+^,) 

2^Z(3A+4A)  j 

The 

equations  for 

the  probabilities 

of  the  first  few  states  are: 

0  = 

■>po.oV»i,i 

0  a 

+2/>plf0 

/^P2,2 

0  = 

^P0,0 

-(' +2^1,0 

>P2,1 

0  = 

>»a,i 

0  = 

>P1.1 

>P3,1 

By  subtracting  the  first  from  the  second,  the  second,  third  and  fourth 

equations  can  be  made  to  follow  the  general  recurrence  relationship  except 

that  P.  must  be  redefined.  Let  P  *  =  (p.  n,  p„  0)*.  Thus  P  may  be 
u  u  u,u  u,u  n 

expressed  in  terms  of  PQ*. 

P  =  *  n  >  1 

n  0 

Unfortunately  pQ  is  still  an  unknown  in  this  expression.  Although  further 
transformations  of  this  relationship  are  possible,  they  do  not  appear  to 
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stimulate  one’s  intuition.  There  are  three  real  distinct  eigen  values  of 
R,  tut  they  are  not  simple  in  form.  The  cubic  equation  w.iich  they  satisfy 
does  not  factor  easily. 

The  evaluation  of  pQ  and  the  mean  number  of  jobs  in  the  system 
require  summation  of  the  p's.  For  analytic  work,  generating  functions 
appear  to  be  somewhat  easier  than  direct  methods  of  attack.  Again  define 


/  ; 


n=0 


and 


From  the  original  form  of  the  steady  state  equations  one  obtains: 


I  :\Z-A-2/a  /'/z 

\ 


A  Z-\ -2/, 


\0 


°  \ 

/'/z 

/ 

•\  Z-A  / 


;/+ 


/  2.,, 


-2 


\° 


0  ) 

%z 


/p  0,0 


\ 


1,1  i 

i 


=  0 


Remembering  that  the  first  steady  state  equation  is  Ap^  ^  j*  ^  is 

possible  to  eliminate  p  .  Furthermore,  the  problems  at  z  =  1  can  be 
eliminated  by  replacing  one  equation  by  the  sum  of  the  emintions  divided 
by  (z-1).  Completing  both  operations  one  obtains: 


Xz-M-2/^  /y/z 


0 


\  0 


A  -r/z  x  -  Vz  ! 

From  this  one  obtains: 


^  i 

Xz-X-'JU  j 


T=  p, 


0,0 


T\ 

+A 


z  / 


7T-  ^ 


//•<(/,Az)  (2^z-3  A-4/C,) 


,  / 


\ 


I  >,  z[2/J.\z-'>\yu)-(.\z-/U)(\z-)\-2/.,)  }  j 

/ 


1  >.  2z2{oz-/-3A|) 


/ 


where 


d  =  X3z3-2A3z2-5V/,z2+  fw-8  V2w5  ^z-3  A^2-4^ 
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At  z=l,  //"gives  the  marginal  probabilities  in  N  in  terms  of  p  . 

A  V  fU 


7T(  1)  = 


_  po.o 


/  4^) 


- T- r~rr  j  4/,  -2> 

^  (4,  -5  )  \  ' 

,3  A2 


Summing  these  probabilities  and  equating  the  sum  to  one  gives  pQ 


4^-5/') 


^0,0  >+4 


The  condition  that  operations  are  all  valid  is  that  pQ  Q  be  a  probability. 
Since  the  numerator  is  always  less  than  the  denominator,  one  need  only  re¬ 
quire  4^.-5^  >  0  or  ■\/,J  <  4/5.  Thus  the  capacity  of  this  system  is  4/5 
compared  to  the  2/3  found  for  the  previous  system. 

The  expected  value  of  N  can  be  found  from  '!  '(1)+  T'(l)+  IT'  (1)  . 

JL  U  X  Z 

Carrying  out  this  process  using  /-=  ,  one  finds: 


E(NX) 


,o  (12+5  )  (2-/.  ) 
(4v  )  (4-5^) 


Inspection  perhaps  is  not  sufficient  to  relate  this  to  the  value  found  in 
the  previous  model;  however,  when  plotted  as  in  figure  1,  the  anticipated 
reduction  is  clear. 

The  expected  number  of  completed  job  parts  still  in  the  system, 
E(N„)  may  be  computed  as  before. 

E(V  “  °'£(  l)+l^(l)+2/^(l)  = 

This  is,  of  course,  always  greater  than  which  was  the  value  in  the  pre¬ 
vious  system. 

4.  Unspeclalized  Servers 

Another  system  which  can  be  easily  solved  completely  occurs  if 
one  changes  the  nature  of  the  servers.  Suppose  the  servers  are  not  special¬ 
ists,  so  that  either  server  can  process  either  part  of  a  job.  The  algebra 
is  only  easy  if  one  continues  to  consider  only  two-part  jobs  and  two 
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servers;  thus,  this  restriction  is  maintained.  In  this  case,  as  long  as  there 
is  a  part  of  a  job  waiting  to  be  started,  neither  server  is  idle.  This  model 
undoubtedly  is  much  less  general  than  the  previous  ones  in  which  the  servers 
were  specialists,  but  it  provides  some  insight  into  congestion  processes. 

The  definition  of  the  state  of  the  system  variable  is  the  same  as 
in  the  previous  section.  In  fact,  the  problem  is  only  changed  in  that  one 
transition  rate,  (n+l,2  )  to  (n  ,  1  ) ,  has  been  increased  from  ^ to  2  since 
both  servers  are  always  busy  if  there  is  any  work.  This  change  introduces  a 
symmetry  into  the  state  space  diagram  which  was  not  previously  present.  Not 
only  are  the  transition  rates  (n+1 , 1  )  to  (n+1, 2.)  and  (n+1,1  )  to  (n,0) 
equal  but  also  the  rates  (n,0  )  to  (n,l  )  and  (n+1, 2.)  to  (n,l  )  are  now 
equal.  Thus,  there  is  a  symmetry  in  the  role  of  (n,0  )  and  (n+1, 2  ).  State 
Space  Diagram: 


N 


1 


2  .  s'* 

'  y'/ 


r 


<*j  i'> 


2‘. 


■> 


/ 


/V  A  2+j 

;  t 


0  !  2  N2 


The  existance  of  state  (0,0),  however,  prevents  the  symmetry  from  being 
perfect  which  would  permit  a  reduction  in  the  number  of  states  to  be  con¬ 
sidered. 


The  solution  process  follows  that  of  the  previous  model .  The 
recurrence  relationship  is: 


0  =  >iP  ,  + 
n-1 


->,-2 

!  o 


,  0 

\ 


VA 


2,  • 

0 


2/'  \ 

•  ) 
--2/0-  j 


.0 

P  +  \ /■* 
n  I 


0 

0 

0 


0\ 


n+1 
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Only  then's  in  column  three  of  the  second  co-efficient  matrix  have  been 
changed.  Summing  equations  this  reduces  to: 


+2  4  —2  S  y 

i 

>Pn_1  =  -A/2  0+^)/2 

\  -</2  -  /2 


^  \ 

-  >/2  P 

n 

<>+V)/2/ 


The  matrix  may  be  inverted  giving: 


P 

n 


/  X 
/  2 


/ 

2 


i  802 

I 

>  .X2 


\ 
\ 


>. 

2^ 

4  >  +2.-  )  +  X* 

8  ...  (  +2//) 

>.2(>+4/:) 

8//>2CN+2/^) 


- - -  \ 

2.  -  \ 

•2('+4  ,)  ■  P  . 

-  ,  n-2 

a...  (.  +2„)  i 

-•  j 

8a,2(,.+2/J  j 


For  this  case,  the  eigen  values  are  reasonably  concise  expressions  and 
distinct;  so  the  recurrence  relationship  may  be  put  in  a  form  that  facili¬ 
tates  expressing  P  in  terms  of  P, . 

n  1 

P  =  TDT_1P  , 
n  n-1 


where 


To!  1 

\ 


V 


\ 

/  > 


1 


1 


+ 


1 

2 


•\(  X-*-4.u+r) 


8^ 


1  ' 


n-1 


^(A+4^-  r~) 
2 


8 


A* 


"  I 

) 

A- / 

X+2 
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using  ('"'for  (/  /M''+ 8/<)  . 

Now  the  equations  for  the  first  few  states  are  again  special. 


0  = 
0  = 
0  = 
0  = 


~aP 


0,0 


>P0,0 


+^P1,1 

-(,+/>)  p 


1,1 


+2/pi,o 

-«+a*)PIj0 


+2/.P 


2,2 


-<>.+^)P2f2 


+/wP2,l 

^P2,l 


By  subtracting  the  first  equation  from  the  second,  one  makes  these  initial 
equations  like  the  general  ones  as  far  as  the  P  and  P 


terms  are  concerned. 

n  n+1 

The  recurrence  relations  can  now  be  written 


Define  PQ*  as  <Pg>0,  P0>0,  0)t 
as  P  =  TDnT  *P  .  The  reader  unfamiliar  with  this  I'esult  for  the  nth 

n  0  __ -i  2  _ ~i  «. i  2  —i 

power  of  a  matrix  can  verify  that  (TDT  )  =  TDT  TDT  =  TD  T  .  An  induc¬ 

tion  on  n  completes  the  result.  Raising  a  diagonal  matrix  to  the  nth  power 
merely  requires  raising  the  elements  to  the  nth  power.  The  expression  may 
be  further  simplified  by  performing  the  multiplication  and  rearranging  the 
result  in  the  form: 


P 

n 


P0,0  ! 


4  r- 

3^+ 

4  >r  ' 


,-A+t  ■ 


|  3^-+f 

\  4/ 


\ 


-3^+ 

4  .  — 


-34+  r 


4  l- 


1  ' 
2  i 


0 


/t"~5  <Woin\ 


1  /  8/a 


;  [JL 
I  8y/ 


ii  !(— )n 

2  i  V  >■  +2/0. 


This  result  could,  of  course,  have  come  from  generating  function  analysis. 
This  type  of  analysis  has  its  problems  although  it  is  more  mechanical .  Using 
generating  functions,  one  never  finds  the  transformation  which  puts  the 
recurrence  relationship  into  simple  form.  Before  finding  the  transformation, 
it  was  hoped  that  it  might  provide  heuristics  for  use  in  other  problems. 

The  role  of  the  symmetry  noted  previously  is,  of  course,  displayed  in  the 
eigen  vectors  which  are  the  columns  of  matrix  of  the  transformation  T. 

Other  than  this,  little  insight  seems  possible  from  this  example. 

The  generating  functions  are  easily  obtained  from  the  last  result 
because  of  the  geometric  structure.  The  generating  functions  are  a  useful 
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method  for  summing;  the  probabilities  to  evaluate  p,.  f  and  finding  the  ex¬ 
pected  value  of  simultaneously.  To  find  the  generating  functions  directly 
from  the  steady  state  equations,  one  may  proceed  as  in  the  previous  model. 
Again  let  be  the  vector  of  generating  functions  ft  A.z) ,  i  =  0,  1,  2.  The 
original  form  of  the  steady  state  equations  gives: 


Cl' 

1 

1 

N 

/7z 

o  ■ 

1 

2yx 

°  \ 

2.^ 

>z->— 2/y. 

•  //  + 

1  -2/ 

/A  Z  1 

0 

V 

A1 

1 

✓< 

1 

N 

0 

~/<Zj 

\ 


Again  p  =  pl  and  the  sum  of  these  equations  can  be  divided  by  z-1 . 
J ,  u  -*■ ,  i 

Thus,  one  must  solve: 


N 

1 

f 

/.</z 

0  \ 
1 

,  "2/-<  \ 

V 

N 

A  Z~/A 

Az-2^  | 

1 

II 

o 

P0,0 

\  o 

A'- 

AZ-^-2/,  j 

\  Az  ,■ 

\  / 

The  result  is: 

J[  -  .»?.». 9 _ _ _ 

(  \ +2  -  A  z)  (+4/U  -  (  >2+4  'Xju, )  z+  >2z2) 


>2  2  2  \ 
2Uz  -3Pi,fcz-8/i/d 

/'  z(4/e>  -  A  z)  Ov+2^- 

V  >>V (3  >»->.*) 


2-  2  3' 

z+4  A  fU  +0  A  \ 

Az) 


/ 


Summing  the  components  of  7^”  evaluated  at  1  and  equating  the  sum  to  zero  gives 


’ 

Using  /°  = 

2-2 

P0,0  =  2+  /"O 

All  of  these  operations  are  legitimate  if  /°  <  1  or  the  system  capacity  is 
one. 

The  sum  of  the  derivatives  of  the  generating  functions  evaluated 
at  one  gives: 


E(V 


12- ^-2/°  2 
1-/0  8+4  .A> 


This  measure  of  system  performance  is  interesting  when  compared  to  the  single 

server  system  with  load  ratio  =  /  .  At  low  loads,  the  single  server 

2 

produces  less  congestion  since  (12-  P  -2/>  )/(8+4 /o)  approaches  3/2  as  /^approach¬ 
es  0.  This  is  the  effect  of  each  job  having  two  phases  and  the  job  remain¬ 
ing  in  the  system  until  the  longer  phase  has  been  completed.  This  is  precisely 

2 

what  one  anticipates.  Since  (12-/^ -2  .  )/(8+4/')  approaches  3/4  as  /a  approaches 
li  the  situation  is  reversed  at  high  loads,  and  the  two  server  system  has  less 
congestion.  This  result  appears  to  be  less  intuitive,  at  least  among  those 
colleagues  who  have  been  bold  enough  to  nazard  a  guess.  The  heuristic  explan¬ 
ation  of  this  phenomenon  is  the  crucial  nature  of  the  job  requiring  excessive 
service  under  heavy  load.  In  the  single  server  case,  there  is  no  output  from 
the  system  while  such  a  job  is  in  service.  On  the  other  hand,  in  the  two- 
phase,  two-server  case,  complete  blockage  requires  that  two  very  long  phases 
occupy  the  servers  simultaneously. 

Compared  to  ttu  two  previous  models,  this  model  shows  a  marked 
reduction  in  congestion  as  expected.  Figure  1  shows  the  expected  number 
of  jobs  in  the  system  for  all  three  models  discussed  here  and  the  standard 
single  channel  system. 

As  far  as  the  number  of  completed  job  phases  is  concerned,  one 

must  first  find  the  marginal  probabilities  in  N  which  are  given  by  T (1) . 

»  1 


E(N2) 


>«U-»  +  6>f 

2/L,(X+2/0  4,0+2/,) 


This  is  again  the  minimum  size  of  this  type  of  inventory  found  in  the  first 
model.  It  is  interesting  that  as  far  as  E(N  )  is  concerned,  the  increase  in 
the  effective  service  rate  tending  to  reduce  congestion  just  balances  the 
effect  of  increasing  the  maximum  number  of  jobs  in  the  system. 

5.  Conclusions 

The  specific  results  have  been  commented  on  as  they  were  developed 
and  need  not  be  summarized.  A  word  of  caution  does  need  to  be  added. 
Congestion  is  but  one  of  many  measures  of  system  performance  and  perhaps  of 
negligible  importance  in  many  cases.  Furthermore,  when  one  makes  compari¬ 
sons  among  models  as  nas  been  done  here,  he  compares  them  naturally  with 
respect  to  the  characteristics  which  happen  to  be  under  study.  Among  the 
models  discussed  here,  there  are  qualitative  differences  of  the  greatest 
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importance  in  any  real  design  problem.  Thus,  one  must  be  cautious  in  saying 
that  one  system  is  always  preferable  to  another.  What  a  theoretical  inves¬ 
tigation  such  as  this  hopes  to  explore  is  how  strong  is  the  preference  of 
one  over  another.  For  example,  there  are  undoubtedly  many  situations  in 
which  the  increase  in  service  rate  due  to  specialization  is  so  great  that 
the  system  of  model  two  is  far  preferable  to  that  of  model  three  as  far  as 
congestion  is  concerned.  Thus,  none  of  tne  systems  here  can  be  ruled  out 
of  design  questions  on  the  basis  of  what  is  reported  here  alone.  Perhaps 
as  the  study  of  networks  of  queues  continues,  there  will  emerge  dominant 
forms  of  organization.  This  time  has  not  yet  come. 

The  study  of  these  systems  was  oegun  not  merely  because  of  their 
interest  but  rather  because  they  are  examples  of  a  general  class  of  queuing 
networks.  This  class  is  that  for  which  the  state  of  the  system  variable 
has  more  than  one  dimension  and  only  one  component  is  allowed  to  have  infi¬ 
nitely  many  values.  This  permits  the  discussion  of  the  states  in  groups. 
This  sort  of  system  results  when  one  has  a  network  system  with  only  a  finite 
number  of  waiting  spaces  internally  but  an  unlimited  number  externally. 

The  internal  limitations  may  be  either  physical  or  the  result  of  control 
rules.  Also  implicit  in  the  concept  of  this  class  v/as  the  requirement  that 
a  group  recurrence  relationship  exist  at  least  from  some  point  on.  The 
order  for  the  groups  is,  of  course,  provided  by  values  of  the  one  queue 
permitted  to  become  infinite.  The  pressing  question  is  how  to  reduce  the 
infinite  problem  to  one  of  solving  a  small  number  of  linear  equations  for 
the  first  few  states  not  following  the  general  pattern  and  then  to  apply 
the  recurrence  relationship  to  produce  the  tails  of  the  distribution.  This 
is  precisely  what  was  done  in  all  three  models.  The  general  form  of  the  co¬ 
efficient  matrix  of  the  steady  state  equations  was 


/  A* 

B* 

C* 

0 

0 

0 

i 

1  0 

A 

B 

C 

0 

0 ! 

o 

0 

A 

B 

C 

0  j 

:  0 

0 

0 

A 

B 

C  I 

i 

t 


The  matrixes  A*,  A,  B,  and  C  are  all  square.  The  fundamental  step  in  solu¬ 
tion  was  to  put  this  into  a  truncated  form  which  gives  the  probabilities  up 
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to  a  scale  factor, 

A*  B*  C* 

A  B** 

If  one  can  truncate  the  system  here,  he  can  do  it  at  any  level  with  the 
same  B**.  In  the  cases  studied,  B**  could  easily  be  produced.  One  may 
think  in  terms  of  purely  formal  methods  of  eliminating  C  from  the  last  group 
of  equations,  or  he  can  provide  an  interpretation  for  B**  which  can  assist 
in  finding  it.  The  entries  of  B**  are  the  usual  probabilities  of  single- 
step  transitions  plus  some  additional  probabilities.  The  latter  may  be 
interpreted  as  the  probability  that  the  state  of  the  system  starting  from 
one  state  in  group  n,  goes  to  one  of  the  states  in  n+1  and  eventually  comes 
back  to  another  state  in  group  n,  not  having  been  in  group  n  in  the  mean¬ 
time.  Note  that  the  structure  assumed  in  the  form  of  the  steady  state  equa¬ 
tions  implies  that  the  only  communication  between  states  in  group  n+1  and 
group  n-1  is  through  states  in  group  n.  Thus,  since  the  state  of  the  system 
first  moves  to  group  n+1 ,  the  restriction  that  no  value  in  group  n  is  assumed 
in  the  interval  is  equivalent  to  saying  that  the  state  of  the  system  remains 
in  group  n+1  or  higher.  The  length  of  the  time  interval  required  for  these 
transitions  is  immaterial.  Another  way  to  think  about  this  is  to  say  that 
a  new  truncated  process  is  considered  which  agrees  with  the  original  one 
when  the  state  of  the  system  takes  a  value  in  group  n  or  a  lower  group. 

When  the  state  of  the  system  in  the  original  process  is  in  groups  higher 
than  n,  the  new  process  is  not  defined  and  time  is  measured  only  when  the 
process  exists.  Clocks  are  stopped  when  a  transition  from  n  to  n+1  occurs 
and  started  when  the  opposite  occurs.  The  two  processes  have  the  same 
steady  state  probabilities  up  to  a  scale  factor.  If  transitions  from  group 
n+1  to  group  n  can  only  occur  from  one  state  in  group  n+1  say  (n+l,i),  then 
the  probabilities  which  convert  B  to  B*  are  products  of  probabilities  of 
leaving  group  n  times  the  conditional  probability  of  going  from  (n+l,i)  to 
a  particular  state  in  group  n  given  that  a  downward  transition  occurs  from 
(n+l,i).  These  are  almost  immediately  available  from  the  state  space  dia¬ 
gram.  In  the  last  two  models,  they  were  of  the  form  (1/2)  since  it  was 
equally  likely  to  go  from  (n+1,1)  to  (n+1, 2)  or  to  (n,0).  If  there  had 
been  two  or  more  states  in  n+1  from  which  it  was  possible  to  move  to  states 
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in  group  n,  it  would  have  been  necessary  to  evaluate  these  probabilities 
considering  the  possible  histories  of  any  length  starting  from  a  state  in 
group  n  and  ending  at  another  state  in  the  group.  This  opens  Pandora’s 
box,  for  in  general  it  represents  a  difficult  counting  problem  typical  of 
combinational  problems. 

The  other  difficulty  in  the  algebra  of  these  problems  was  putting 
the  probabilities  in  the  form  of  sums  of  geometric  terms.  This  provides  a 
severe  limitation  on  analytic  work  since  it  involves  finding  roots  of  poly¬ 
nomials  whose  degree  is  equal  to  the  group  size.  Unfortunately,  in  more 
complex  systems  this  becomes  confounded  with  the  truncation  problem  or  per¬ 
haps  might  as  well  be  attacked  simultaneously. 

Thus,  the  amount  of  understanding  of  queuing  networks  which  can 
be  gained  from  purely  analytic  work  appears  to  be  quite  limited.  On  the 
other  hand,  there  certainly  is  a  set  of  systems  slightly  more  complicated 
than  those  considered  here  for  which  reasonable  methods  of  numerical  solu¬ 
tion  may  be  found. 
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